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Abstract. We consider the high order moments estimator of the frontier of a random pair in- 
troduced by Girard; S., Guihou, A., Stupfler, G. (2012). Frontier estimation with kernel regression 
on high order moments. It is shown that this estimator is strongly uniformly consistent, and its 
rate of convergence is given when the conditional cumulative distribution function belongs to the 
Hall class of distribution functions. 
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1 Introduction 

Let {Xi, Yi), . . . , {Xn, Yn) be n independent copies of a random pair {X, Y) such that their common 
distribution has a support defined by S" = {{x, ?;)Gf7x]R; < y < g{x)} , where is a compact 
subset of W^. The unknown function g is called the frontier. In Girard et al. (2012), a new estimator 
of g is introduced, based upon kernel regression on high order moments of the data: 

gn{X) apn I fJ-{a+l)p„ + l(x) ^ip^ + i[x) 

where (p„) is a nonrandom positive sequence such that p„ oo, a > and 

1 " 

^lpAx)^-y2YrK^,Jx-x,) 

1=1 



(1) 
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is a kernel estimator of the conditional moment mp^{x) = E(yP" \X = x). Classically, K is 
a probability density fmrction on R'', K}^{u) ~ h^'^ K{u/h) and (/i„) is a nonrandom positive 
sequence such that hn — > 0. From a practical point of view, the use of a small window-width hn 
allows to select the pairs (X^, Yi) such that Xi is close to x while the use of the high power p„ gives 
more weight to the Yi close to g{x). Using high order moments was first suggested by Girard and 
Jacob (2008) in the case when Y given X is uniformly distributed. This approach was also used in 
Girard and Jacob (2009) to develop a local polynomial estimator. 

Uniform consistency results in frontier estimation are seldom available in the literature: we refer the 
reader to Geffroy (1964) for the miiform consistency of the blockwise maxima estimator when the 
conditional distribution function of Y given X is uniform, and to Jacob and Suquet (1995) for the 
uniform consistency of a projection estimator when the observations are realizations of a Poisson 
process whose intensity is known. In both papers, the respective rates of uniform convergence are 
not given. In the field of econometrics, where the frontier function is assumed to be monotonic, the 
uniform consistency of the Free Disposal Hull (FDH) estimator introduced by Deprins et al. (1984) 
was shown by Korostelev et al. (1995), along with the minimax rate of uniform convergence; the 
uniform consistency of isotonized versions of order— m frontiers introduced in Cazals et al. (2002) 
is proven in Daouia and Simar (2005), but rates of convergence are not available in this study. 
Consistency results in the sense were studied by Girard et al. (2005) for an estimator solving 
an optimization problem and by Geffroy et al. (2006) for the blockwise maxima estimator. The 
minimax rate of L^— convergence was established by Hardle et al. (1995). 

Outside the field of frontier estimation, uniform convergence of the Parzen-Rosenblatt density es- 
timator (Parzen, 1962 and Rosenblatt, 1956) was first considered by Nadaraya (1965). His results 
were then improved by Silverman (1978) and Stute (1982), the latter proving a law of the iter- 
ated logarithm in this context. Analogous results on kernel regression estimators were obtained by, 
among others. Mack and Silverman (1982), Hardle et al. (1988) and Einmahl and Mason (2000). 
Uniform consistency of isotonized versions of order— a quantile estimators introduced in Aragon et 
al. (2005) was shown in Daouia and Simar (2005). The case of estimators of left-truncated quantiles 
is considered in Lemdani et al. (2009). 

The paper is organized as follows. Our main results are stated in Section [2j The estimator is 
strongly uniformly consistent in a nonparametric framework. The rate of convergence is provided 
when the conditional survival function oiY given X = x belongs to the Hall class (Hall, 1982). The 
rate of uniform convergence is closely linked to the rate of pointwise convergence in distribution 
established in Girard et al. (2012). The proofs of the main results are given in Section[3l Auxiliary 
results are postponed to the Appendix. 
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2 Main results 



Our results are established under the following classical condition on the kernel: 



(K) K is a. probability density function which is Holder continuous with exponent r]K- 



3cK>0, yx,yeW^, \K{x)-K{y)\<CK\\x-y 




and its support is included in B, the unit ball of R'^. 

Note that (K) implies that K is bounded with compact support. We first wish to state the uniform 
consistency of our estimator on f7. To this end, three nonparametric hypotheses are introduced. 
The first one states the existence of the frontier g. 

{NPi) Given X = x, Y is positive and has a finite right endpoint g{x). 

Let T{y \x) = F{g{x)y\ x) be the conditional survival function of the normalised random variable 
Y/g{x) given X = x. The second assumption is a regularity condition on the conditional survival 
function of Y given X along the upper boundary of S. 

{NP2) There exists yo € (0, 1) such that for all y € [yo, 1], x i->- J^{y \ x) is continuous on fl. 

The third assumption can be seen as a regularity condition on the (normalised) conditional high 
order moment mp^{x) / g^" (x) = E{{Y/g{x)y^ \ X = x). 



Let / be the probability density function of X. The following regularity assumption is introduced: 

{Ai) / is a positive continuous function on O and 5 is a positive Holder continuous function 
with Holder exponent r]g. 

Before stating our first result, let us introduce some further notations. For any real-valued function 
7 on R"^, the oscillation of 7 between two points x and x — hnU, u G B, is denoted by 



{NP3) For all c > 1 




as n — )• 00. 



Al{x, u) = j{x - hnu) - 7(x). 



Finally, let jJip^ix) be the smoothed version of the conditional moment mp^{x), namely 




Our uniform consistency result may now be stated: 



Theorem 1. Assume that {NP^ - NP3), (K) and {Ai) hold. If 
Pn as 00, then 



nhi (x) 



— )• 00 and 



logn xeQ 



sup \gnix) — g{x) \ — almost surely as n ^ 00. 
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As far as the conditions on and (/i„) are concerned, let us highlight that, under (Ai) and since 
57 is compact, / is uniformly continuous on 57 and inf / > 0. As a consequence, the uniform relative 
oscillation of / can be controlled as 

/(X - hnU) 



sup sup 

xen ueB 



fix) 



sup sup 

2;Gf2 u£B 



fix) 



0. 



Similarly, inf <? > and we thus have 



sup sup 



Remarking that 
entails, if pn /in' 



log 



gix) 

''"{x - h„u) 



0, 



sup sup 

xen ueB 



gP^ix) 

P"-{x - hnU) 



Pn log 



oiK^)^Q. 

Kix, u) 



(2) 



(3) 



1 



gix) 



- 1 



(4) 



gP^{x) 

As a conclusion, the condition p„ hPn ^ thus makes it possible to control the oscillation of g^^ 
around x. uniformly in a; G i7. This condition was already introduced in Girard and Jacob (2008 
2009) and in Girard et al. (2012). 

Besides, for all w e £7, 

m(a+i)p„ iv) _^ ^^^^ \v)dy>{l- l/p„)(''+i)^'" Til - l/pn I v) 



K{u) du 



g(°+i)P'.(w) 
so that, under the condition pn — >■ 0, 



M(a+l)p„(a^) 
^(a+l)p„(2,) 



i(a+l)p„ ix - hnU) ^('^+1)?" (a; - hnU) f (x - Ku) 



gia+i}p„ - hnu) g(''+i)P"(a;) f{x) 
> e-f-^+i' fix) [ y{l - I X - Ku) K{u) du (1 + 0(1)), 



uniformly in x G i7, see ([2]) and ([4]). Consequently, under the additional mild regularity condition 
J"(l - 1/pn I a; - /inU) 



(NP^) sup sup 



- 1 



as n — > c». 



T{1 - l/p„ I x) 

it appears that a sufficient condition for Theorem [T] to hold is 

— inf J-{1 — 1/pn I a:) — > oo. 



(5) 



logn icssi 

The behavior of the frontier estimator is thus linked to the conditional number n hf^J-{l — 1/pn \ x) 
of the exceedances over the level gix){l — l/pn) in the ball B{x, h). 

Our second aim is to compute the rate of convergence of the estimator ([T]) under less stringent 
conditions than in Theorem 3 in Girard et al. (2012). The conditional survival function of Y/g{x) 
given X = a; is assumed to check the semiparametric hypothesis 

(SP) For ally e [0, 1], Tivlx) ^ (1 -?/)"("=) L {x, (1 - y)^^), where i is bounded on 57 x [1, oo) 
and satisfies 

Vx e 57, Vz > 1, L{x, z) = C(x) + D{x, z) z^^(^) 
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where a, /3 and C are positive Borel functions and £) is a bounded Borel function on x [1, oo). 

For all a; e 51, the function L(x, •) is slowly varying at infinity (see for example Bingham et ai, 1987) 
and belongs to the Hall class (Hall, 1982). Let us emphasize that a{x) drives the behavior of the 
distribution tail of Y given X — x in the neighborhood of its endpoint g{x). In the general context 
of extreme- value theory (see for instance Embrechts et ai, 1997), the conditional distribution of Y 
given X — X is said to belong to the Weibull max-domain of attraction with conditional extreme- 
value index —l/a{x). The model (SP) is clearly more general than the one in Girard et al. (2012), 
which is restricted to the constant case L = 1. 

An additional regularity condition is necessary: 

{A2) a is a Holder continuous function with Holder exponent rja', P and C are continuous 
functions on Vt and there exists zq G [1j 00) such that for all z > zq, the map x t-^ D{x, z) is 
continuous on f2. 

Let us remark that assumption (SP), {Ai — A2) and Pnh^n clearly entail (NPi), {NP2) and 
{NP4). Besides, for all c > 1, Proposition [2] below yields 

t^CPn (*^) 



sup 



fix) C{x) T{a{x) + 1) (x) (cp„)-"(-) 
Using Lemma [5] (see the Appendix) then gives 



— )■ as n — 00. 



sup 



y-P"-'j^{y\x)dy 



C{x)r{a{x) + 1) (cp„)-°(^) 



as n — > cx). 



We therefore obtain that if hypotheses (SP), {Ai — A2) and Pnhn" —>■ hold, then assumption 
{NP3) holds as well. In particular. Theorem [1] holds in that semiparametric setting. Besides, if 
(^2) holds. 



a := max a < 00 and B := min/3 > 
n — n 



because n is compact. 



Letting w„ = ynpn"'^'^ /i^/logn, we can now state our result on the rate of uniform convergence 
in the semiparametric framework (SP): 

Theorem 2. Assume that (SP), {K) and {Ai - A2) hold. If 

• ''T'Pn" 'in/log" — > 00 as n ^ 00, 

• limsupw„ V p;;^ hi" V pn- ^\ < 00, 



then 



Wn sup \gn{x) — g{x)\ = O (1) almost surely as n 00. 
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Let us highlight that the condition np~" /ij^/logn — > cx) is exactly condition ([5]). The second 
condition controls the bias of the estimator ^„ . The term h^^ corresponds to the bias introduced by 
using a kernel smoothing, while the presence of both other terms is due to the particular structure 
of the semiparametric model {SP). Moreover, as pointed out in Theorem 3 in Girard et al. (2012), 
the rate of pointwise convergence of gn{x) to g(x) is \J npn"'^'^-''^'^ /ij^. Up to the factor ^/logn, 
the rate of uniform convergence of 5„ is therefore the infimum (over f2) of the rate of pointwise 
convergence of gn{x). 

Theorem [5] allows us to compute the optimal rate of convergence of g„ . For the sake of simplicity, 
we shall consider the case when a is more regular than g {i.e. rja > rjg) and J-{y \x) = (1 — 
for all y € [0, 1] (namely, D is identically zero). In that case, the conditions on (p„) and (/i„) reduce 
to _ 

— ^ oo as n — > oo and hm sup < oo . 

log n n^oo log n 



Up to the factor ^\og n, the optimal rate of convergence is obtained if p„ has order n'^^ and hn has 
order where (ci, C2) is a solution of the constrained optimization problem 

(ci, C2) — argmax 1 + (2 — a)c — dc' 
(c, c')eA 

with A = {{c, c) eM.'^ll- ac -de >0, 1 + {2- a)c-{d + 2r]g)c <0, c,c >0}. 

This yields ci — rjg/ld + arjg) and C2 = l/{d + arig), in which case the (optimal) rate of convergence 
has order n^^s/'^'^+^^a) ^ Let us note that this rate of convergence has been shown to be minimax by 
Hardle et al. (1995) for a particular class of densities in the case d — I with a risk. 



3 Proofs of the main results 



Before proceeding to the proofs of our main results, we point out that, due to our hypotheses, all 
our results and lemmas on the behavior of mp^(x), fip^{x) and 'jlp^{x) hold as well when p„ is 
replaced by (a + l)pn- 

The key idea to show Theorem [T] is to prove a uniform law of large numbers for /ip^ {x) in the 
nonparametric setting. 



Proposition 1. Assume that (NPi - NP3), (K) and (Ai) hold. Let w„ = a inf ^^p^^- U 

y logn xen gP"(x) 

Vn ^ 00 and pn hn^ — >■ as n 00, then there exists a positive constant c > such that for every 
£ > and every sequence of positive numbers ((5„) converging to such that (5„ w„ — > 00, there exists 
a positive constant Cg with 



Consequently, 



S„Vn sup 



6n Vn sup 



1 



> e = O 



n exp 



logn 



(52 



Mp„ {x) 



almost surely as n ^ 00. 
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Proof of Proposition [TJ The proof is based on that of Lemma 1 in Hardle and Marron (1985). 
Since is a compact subset of R'', we may, for aU n e N \ {0}, find a finite subset f7„ of ft such 
that: 

yx en, 3x{x) \\x-x{x)\\ <n-'^ and 3 c> 0, |f7„| = O (n=) , 

where \fln\ stands for the cardinality of fin, and r] = d^^ + . Notice that, since nh^ — >■ oo, one 
can assume that eventually x(a;) € B(x, hn) for all x e fl. Picking e > 0, and letting 



and T2.n := 
the triangular inequality then yields 



SnVn sup 



E 



6n V„ 



> 



> 



SnVn sup 



>e) 



The goal of the proof is to show that 

Ti. n + T2^n = O [rf exp 
We start by controlling Ti n- For all a; G il. 



log n 



V-pAx) V-pAx{x)) 



< 



and the triangular inequality entails 



1 " 



Mp„(x(a;)) 



Mp„(x(a;)) 



< 



\KhAx - Xj) - KhM{^) - Xi)\ 
Aip„ (2;) 

l/^p„(2:) - ^J'pAx{x))\ ^11. Y\ 



Mp„(a;) ^^Pr.{x{x)) 

Using hypothesis {K) and Lemma[31 there exists a positive constant k such that, for n large enough, 

KhAx-X,) Kh„{x{x)-X^) 



sup <j (x) 



Mp„ (a;) 



Mp„(x(a;)) 



^{XeB{x, h„)uB{x{x), h„)}- 



Since the support of the random variable Kh^ixi^) ^ Xi) is included in B{x, 2/i„), one has 



sup 



Mp„(2^) h,Ax{x)) 



^^pAx) Mp„(x(a;)) 







< K 









sup -^-^ 

xen fJ'Pr.lx) 



-hi 



{Xi£B{x,2h„)} 



For all X e fl. 



1 " 

-Y^YP"n^x,eBix^2h^)} < snp gP 



B(x, 2h„) 



almost surely, and in view of (jH), it follows that 

A^p„ {x) T^p,Ax{x)) 



sup 



Mp„(a;) Mp„(x(a;)) 







< 2k 









riK 



1 .gP" (x) 
7-7 sup 

< xm /^p„ (a;) 
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for n large enough. Finally, n /i^ — )• oo implies 





Vk 


1 


VK/d 


n ' 















and therefore, we have the following bound: 



S„Vn sup 



< 2k- 



Mp„(a;) Mp„(x(a;)) "■-y„ logn 
as n — )■ oo. Hence Ti^„ = eventually. 

Let us now control T2_n- To this end, pick lo e f2„ and introduce 



sup g 



B{uj, h„) 

Remark that |Z„^ i(a;) — E(Z„.i(cj))| < sup A" almost surely and thus 



d /^p„ (w) - /^p„ (t^) _ 1 



sup g'' 



B{lu, h„) 

is a mean of bounded, centered, independent and identically distributed random variables. Defining 

e In (w) hf^ 



T„{uj) 

and A„(aj) 



2 sup K Sn Vn sup g^" 

B S(w,/i„) 

2 _B (^ni^n sup g^*" Var(Z„,i(a;)) ' 



S(lj,/i„) 

Bernstein's inequality (see Hoeffding, 1963) yields, for all e > 0, 







- 1 













sup g- 



Pn 



> 



< exp 



B(u, h„) 

r„(tj)A„(cj) \ 
2(l + A„M/3); 



£ 1 Mp„ (^)^« 

2 5nVn sup 5^'" 



Using once again ([4]), we get, for n large enough. 



. , . ^ . £ w« logn 

mi T„(a;) > . 

i.j60„ 4 sup iiT On 



Moreover, for all lo € Vim 

1 2 



■ 5n Vn sup 5''" /l„ 



A„(a;) esupA B{ui.h„) 

B 



and since sup g''" Z„, = F/'" Kh„{i-v — Xi), it follows that 



sup gP"/i„'' 

B(i..J,?i„) 



E{Zl,{Lo)) [E(Z„,i (..))] 



< sup iiT, 
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so that 



sup < -dnVn- 



Remarking that the function x i— >• l/[2(a; + 1/3)] is decreasing on R_|_, there exists a constant > 
such that, for all u; G 0„, 

logn' 



for all n large enough. Taking into account that |ri„| = 0{n''), this implies that 

logrt 



T2,n = O ( n'^exp 
Notice now that the above bound yields 



(52 



Ve > 0, VP f<5„«„ sup - 1 > 



< oo 



and use Borel-Cantelli's lemma to get the final part of the result. ■ 
With Proposition [1] at hand, we can now prove Theorem [TJ 

Proof of Theorem [TJ Since g is positive and continuous on the compact set fl, it is bounded 
from below by a positive constant. It is then enough to prove that 

1 1 



sup 



g„{x) g{x) 



almost surely as n ^> cxd. 



To this end, notice that 



/^(a+l)p„+l(2;) ^(a+l)p„ + l(a;) M(a+l)p„(3;) L M(a+l)p„ + l (s^) 



M(a+i)p„+i(a;) 



and 



V-Pr.+i{x) ^p„+i(a;) /ip„(a;) 



Mp„+i(a;) 



Mp„ + l(2^) 



Using again the positivity and the continuity of g on the compact set fi. Lemma [21 iii) yields 



sup 



y-Pr. + li^) 



Mp„ {x) 



and sup 

xen 



M(a+l)p„ + l(2:) 



A*(a+i)p„(a;) 



Since A*(a+i)p„(a^)/5'"^^''''"(a^) < fJ-p^i^)/ 9^" i^) (1 +o(l)) uniformly in a; e f2. Proposition [T] entails 



sup 

x&n 



M(a+i)p„(a;) 



— ^ and sup 



Mp„ (x) 



/^P„+i(a;) 5(2;) 



(6) 



almost surely as n — )• 00. The result follows by reporting ([6]) into ([T]). 



Before proving Theorem [21 further examination of the behavior of the high order moment fip^ (x) 
is needed. The next result gives a uniform equivalent of the moment fj,p^ (x) in the semiparametric 
framework. 
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Proposition 2. Assume that (SP), (K), {Ai — Aq) hold and hn" -> as n oo. Then 



sup 



as n ^ oo. 



Proof of Proposition [2l Let us introduce J^j{y\x) = (1 — y)'''-^-' for all y e [0, 1]. In the 
semiparametric setting (SP)^ J-{- \ x) can be written as 

Vye [0, 1], T{y\x)^Cix)T^iy\x)+D{x, (l - y)-') Tc.+^{y\x). 

Pick X e il, and set 



Pn / y^" '^Fa{y\v)dy 



f{v)C[v)gP-{v)KhSx-v) 



{fCg^"){x - hnu)p,ib{pn, a{x - h^u) + 1) K{u)du 



dv 



(7) 



where b{x, y) — I t^^^ (1 — ty^^ dt is the Beta function. With these notations, the high order 
Jo 

moment [x) can be rewritten as 



t^pA^) = M,i{pn, x)[l + e„{Pn, x)] where e„(p„, a;) 



EnjPn, x) 
Mn{pn, X) 



and with 



{fg^"){x - hnU)pnIa+l3,D{Pn, X - knU) K{u) du 



EniPn, X) : = 

Lemma [8] and (|8]) entail 



(8) 

(9) 
(10) 



sup 



Mp„ {x) _ ^ 

Mn{Pn, X) 



as n — oo. 



It is therefore enough to show that 



sup 



Mn{Pn, X) 



f{x)C{x)r{a{x) + l)gP^{x)p-''^''^ 
Lemma [S] establishes that 

M„(p„, x) 



- 1 



as n — ?> oo. 



sup 

x60 



fix) C{x) a{x) gP^ (x) b{pn + 1, a{x)) 
Finally, Lemma [1] gives 

a{x) b{pn + 1, a{x)) 



as n — > oo. 



sup 



r(a(x) + i)p-"^") 



- 1 



as n — >■ oo 



and the result is proven. 



Since the expression of our frontier estimator involve ratios such as /tp^ (a;)//ip„+i(x), we shall then 
compute an asymptotic expansion of fip^{x) / fj,p^+i{x): 
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Proposition 3. Assume that (SP), [K) and [Ai — A2) hold. Ifpnhn" — > 0, then 



tJ-P„ jx) 



a{x) 

Pn + 1 



= 0(1). 



Mp„+i(a;) 5(2^) 

Proof of Proposition [3j Remark that, with the notations of Proposition [5] above, we have 

fip^+i(x) M„(p„ + 1, a;) 

SniPn, X) - Sn{Pn + ^, x) 



(11) 



where T„(p„, a:) 



Recall then the notations of Lemma [5] and write 



sup 



9{x) 



1 



Pn + 1 



Mnjpn, X) 
Mr,{pn + 1, X) 



1 + en{pn + 1, a;) 



Cn {pn: X, u) K{u) du 



^n{Pn + 1, X, u) K{u) du 



Since Ln{pn + 1, x, u) > 0, it follows that 

Cn{pn, X, u) K{v) du 



sup 



^n{Pn + 1, X, u) K{u) du 



< sup sup 

xen ueB 



Cn{Pn, X, u) 



Cn{Pn + 1, X, u) 



O V 



Lemma [S] entails 



sup 

x£Q. 



9{x) 



a{x) 

Pn + i 



MnjPn, X) 
Mn{pn + 1, X) 



- 1 



= O V 



Pn 



Besides, applying Lemma [S] yields sup ''^'"''^ r„(p„, x) — 0(1). Replacing in pTjl concludes the 

x£Q 

proof of Proposition [3l 



We can now give a proof of Theorem [5J 



Proof of Theorem [2l Since, by Theorem[Tl sup \gn{x) — g{x)\ — ^ almost surely, it is enough to 

x£n 

prove that 

0(1) almost surely a,s n 00. 



Wn sup 

xen 



9n{x) g{x) 



Introducing 



1 



1 



{{a + l)p„ + 1) — ^ '- — - (p„ + 1) ^ 

t^{a+l)p„+l[X) ^p,. + i(x) 



Gn (x) apn 

the quantity of interest can be expanded as 

1 1 



and ^„(x) 



gnix) Gnix) 



= ^nix) + 



1 



1 



Gnix) g{x) 



dnix) g{x) 

Both terms are considered separately. The bias term is readily controlled by Proposition [3] 

1 1 



Wn sup 



Gnix) gix) 



= 0[wn{hl^\J^\Jpn- ' } ] =0(1) 
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in view of the hypotheses on (p„) and Let us now consider the random term ^„(a;). LemmalH] 

shows that 



In view of Proposition [U it is therefore sufficient to show that 



apn 



(x) 



(x) 



Wn 

— sup 

Pn x£n 



C\x) =0(1) and ^ sup Ci'H^;) = O (1) 
Pn xsn 



almost surely as n — > oo. We shall only prove the result for (^n\x), since the result will then 

(2) 

be obtained for Qi {x) by replacing p„ with (a + l)pn- To this end, we mimick the proof of 
Proposition [T] For all n G N \ {0}, let il„ be a finite subset of il such that: 



(12) 



yx en, 3x{x) erin, \\x-x{x)\\ <n-'^ and 3 c> 0, |17„| = O K) , 

where rj = d^^ + rjj^^ [l + a~^] and assume that n is large enough so that xi^) ^ B{x, hn) for all 
X € f2. Pick e > and an arbitrary positive sequence ((5„) converging to 0, and let 



5„^sup (<l\x)~C^^\x{x)) 

Pn xGO 



e 

>2 



and T2,„ ^ P <5„ C^^){u^) 



e 

>2 



The goal is then to show that both series T\, „ and 'Ylm -^2, n converge. Without loss of generality, 



we shall assume that (5n \/ npn" h'^/ \ogn — > oo. Let first 



^3, n 



SnWn sup 

xen 



Ti.n ■= P [Sn Wn SUp 

xef.1 

T5,n := P[SnWn SUp 

xeii 

and T6,„ := P[6nWnSup 

xen 



Mp„+i(x(a;)) 
Mp„(x(a;)) 



Mp„(a;) Mp„(x(a;)) 



> 



Mp„+i(x(a;)) 



Mp„(a;) /^p„(x(a;)) 
Mp„+iW Mp„+i(x(a;)) 



16/ ' 



Mp„+i(a;) ^J■p„+l{x{x)) 



> 



Mp„(2;) Mp„(x(a;)) 



Mp„+i(a;) Mp„+i(x(a;)) 
Mp„(a;) /^p„(x(a^)) 



Mp„ (2;) 
Mp„+i(a^) 



> 



16/ ' 

e 

16 



> 



16 



.Mp„+i(a^) Mp„+i(x(a;)). 
so that for all sufficiently large n, Ti^„ < T^^n + Ti,n + Ts^n + Tg^n. A proof similar to the one of 
Proposition [1] gives the bound 



sup 

xen 



Aip„(a;) V-pAxix)) 







< K 









,{x) 



Mp„(a;) Mp„(x(a;)) 

for n large enough, where k is a positive constant. Remark that np^"^ 00 and n/ifj — >■ 00 yield 





Vk 


1 


1/a 


1 








npn"' . 







Recalling that, from Proposition [1] 



' jj^j A^p„ (a^) 
logn a;ef2 gP'^{x) 

12 



Proposition [2] yields Wn = Pn Vn E^nd therefore, applying Proposition [31 T3 „ = and T4 „ = 
eventually as n — > 00, so that T3 „ and T4 „ converge. Furthermore, since e 
Proposition [3] entails 



sup 



Pn 



(13) 



Using once again the equality w„ = p„ w„ and p3p together with Proposition [T] shows that T^.n 
and X]n^6,n converge. As a consequence, X^n-^i." converges. 

To control 72. m we shall, as in the proof of Proposition [1] show that there exists a positive constant 
Cg such that for all sufficiently large n. 



en-) 



e \ / log n 

>2 <exp -c.^ 



Pick w G f2n and let us consider the random variables 



-1+^^k; 



Kh„{uj - Xi), i = 1, . . . , n 



such that 



(14) 



Let now Un,i{u}) = / sup g, so that Un,i{uj) < 1 given {Xi e i3(cLi, /i„)}. It follows that 

/ S(w,/i„) 



ft,"* 



sup 



I^5„,,:(c.) = [/^;^,(c.) 



.1+ sup g ^^"^^\ l/„.,(u;) 



K 



uj ~ Xi 

hn 



Using Proposition [21 the Holder continuity of g and the fact that p„ /i^' — > therefore yields, for n 
sufficiently large, 



{pn + 1) sup 



^„,,(c.) - C/„P",(c.) [C/„,.(^) - 1] X f 
ip 5^'" \ hn J 



sup 



where k' is a positive constant. Some straightforward real analysis shows that 

1 



(p„ + l) sup uP"(l-w) 

«G[0, 1] 



1 - 



e ^ < 00. 



+ 1 . 

Consequently, there exists a positive constant k" such that, for n large enough. 



(p„ + 1) sup 



sup g'' 

B{uj, h„) 



-S„,i{L0) 



The random variables 



■Z'„,i(a;) = {pn + 1) — ^ — " p„ 5'„,i(a;), i = 1, . . . , n 



sup 

S(w,/i„) 
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are therefore uniformly bounded, centered, independent and identically distributed. Let 



2k" Sn Wn sup g^" 
and A„(c.) ^ ^" Mp„+i('-) ^^^^ 



1 



2 (5„it;„ sup 5^" Var(Z„^ i(a;)) 
en" Pn , , „^ (p„ + 1)-^ /i,-'' 

Recalling (1141) . Bernstein's inequality yields, for all e > and n large enough. 



Pn 



> 2 ) - <5^P 



Tn{uj)Xn{u>) 

"2(l + A„H/3) 



Proposition [21 equation (jj]) and the equality w„ — Pn f « entail 

yiogn 



inf Tn(uj) > —— info- ^ 



for large enough n. Moreover, straightforward computations yield 



e [0, 1], sup sup 

x^n u£B 



g{x - hnu) y 



a{x)y + Vniy) 



Mp„ + l(2^) 

with Vn being a sequence of Borel functions converging uniformly to 0. Lemma [H] thus shows that 

E|^„,i(x)|2 



sup 

x£n 



g^PHx)Pn"^''^'^hn'' 

Consequently, applying Proposition [5] to fip^^i{Lo) entails 



0(1) as n — > oo. 



sup — — - 



O Sn 



log n 



as n — > oo. Thus, using once again the fact that the function x l/[2(a; + 1/3)] is decreasing on 
M+, we get that there exists a constant > such that for all n large enough. 



Wn 



Pn 



en-) 



> 2 ) ^ ^^P 



log n 



As a consequence, X]n^2,n converges, (fT2|) is proven, and the proof of Theorem [2] is complete. 



Appendix: Auxiliary results and proofs 



We start by a technical result we shall need to examine the properties of mp^^ (x) and /ip^ (x) in 
Lemma [2] below. It essentially shows that the computation of a conditional high order moment is 
controlled by the behavior of the conditional survival function J-{- 1 x) in a neighborhood of 1. 

Lemma 1. Let h be a positive bounded Borel function on (0, 1), and let pn ^ oo. If {NPi — NP2) 
hold, then for all e G (0, 1 — ya), 



sup 

sen 



y''-~'h{y)T{y\x)dy 



yP"~^hiy)Tiy\x) dy 



— >■ as n 
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Proof of Lemma [TJ Let e G (0, 1 — yo), x E ft and consider the expansion 



yP-~'h{y)J'iy\x)dy^ / yP-^' h{y) J^iy \ x) dy 

'l-s 



yP--'h{y)F{y\x)dy 
yP"~'hiy)T{y\x)dy 



Since, for all yd [1 — e, 1], the function x t-^ J'iyl x) is positive and continuous on fi, it is clear 



that inf T{y | a;) > 0. Consequently 



< sup 



l-e 



yP-~^h{y)T{y\x)dy 



yP--'h{y)F{y\x)dy 



< sup 



< 



(1 — e) sup h 

(0,1) 



y 



l-s 



h{y)T{y\x) dy 



(1 — e) sup h 

(0,1) 



"l-e/2' 




l-e 


Ji 



'l-e/2 



h{y) M T{y\x)dy 



Remarking that 



l-e/2 



ip^-i 



l-e 



— >■ cxD as n — ^ cxD, we get the desired result. 



The following lemma examines the behavior of the conditional high order moment mp„ (x) and its 
smoothed version iip^(x) in the nonparametric context. 

Lemma 2. Assume that (NPi — NP3) and (Ai) hold. Let K be a probability density function on 
M.'^ with support included in B. If Pn h'n ^0 as n ^ 00, then 



(i) sup 

xen 



(ii) sup 

x£Q 



(Hi) sup 



f{x) mp^{x) 
mp^+i{x) 



mp„ix) 



-9{x) 
- 9{x) 



as n 00 , 



-> as n — > cx) , 



as n 00. 



Proof of Lemma [2l (i) Let us remark that 



so that 



Besides, 



/^Pn {x) = I K{u) f{x — hnu) rup^ (x — /i„u) du, 



f{x) mp„ {x) 



, f{x - hnu) mp^{x - hnu) 

K{u) —■ ^ du. 

J {x) rup^ {x) 



rup^ [x - hnu) _ gP" {x - hnu) Jq 



y^" ^F[y I a; - /i„u) dy 



rup^ix) 



gPr. (a;) 



yP" ^J^{y\x)dy 



From (H]), (g]) and hypothesis {NP3), it follows that 

f{x)mp^ {x) 



K{u) du = 1 
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uniformly in x £ D, as n ^ oo, which proves (i). 
(ii) Similarly, we have 



1 + — 

Pn 



y^^Tiy I x) dy 
yP--^y{y\x)dy 



Note that 



^ — — 

yP"F{y\x)dy / yP-~\\ - y)F{y\x) dy 
_ ^0 



yP--^F{y\x)dy f y^--^ F{y\x) dy 

"'0 

and let e e (0, 1 — j/o)- Lemma [1] shows that, for all n large enough, 



sup 

sen 



1 - 



j/P" J"(j/ 1 a;) dy 



y^--^F{y\x)dy 



<(! + £) sup 

xen 



yP--\\-y)F{y\x)dy 



l-e 



yP"-ij-(y|x) dy 



l-e 



< £(! + £) 



and the result follows. 

(iii) is a consequence of (i) and (ii). 



The third lemma of this section establishes a uniform control of the relative oscillation of /Zp„ . 

Lemma 3. Assume that {NPi — NP^), (K) and {Ai) hold. Let (£„) be a sequence of positive real 
numbers such that En < hn- If Pn hn" — > as n oo, then 

-1 riK- 



sup sup 

xGfl z£B{x,€„ 



= o 



Proof of Lemma [3l For all x G 17 and z e B{x, £„), we have 

IMp„(^) - Mp„(^)l <E{YP- \Kh^{x -X)- Khjz -X)\) 
Hypothesis [K) and the inclusion B{z, /i„) C B{x, 2ft,„) now entail 

■\\x-z\r'< 



\KhAx - X) - Kh^z - X)\ < 



< 



"n 
CK 

hi 



{XeB{x,h„)uB{yJi„)} 



riK 



1 



{JfeS(a;,2/i„)}- 



Let V be the volume of the unit ball in R'', JC = Ib/V be the uniform kernel on 
JCh{u) = h^'^ K.{u/h). The oscillation of iJip„{x) is controlled as 

"I 



sup |/ip„ {x) - Mp„ (z)| < 2'' ckV E (yP" /C2/,„ {x - X)) 

z£B{x, e„) 



and let 



(15) 



Note that /C is a probability density function on R'^ with support included in B. Therefore, 
Lemma [21^1) yields 



sup 

xGQ 



iE(rP" iC2hA^-x)) 



f{x)mp^ (x) 



- 1 



as n — >■ cxj. 
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Applying Lemma once again gives 



sup 



which, together with ([T5t . yields the result. 



as n oo 



Lemma |4] below is a useful tool in establishing uniform expansions for ratios of Gamma functions: 
Lemma 4. For all z, z' > 0, one has 



1 1 

z z' 



2/ V 2, 

Proof of Lemma[4l From (6.1.50) in Abramovitz and Stegun (1965), p. 258, one has 



logr(z) 



z — i I log z — z +1: log 271 + 2 



arctan(t/z) 



2 J ' ' 2 "° " ' Jo 62^^* 

Now, since x i— >■ arctana; is a Lipschitz function on R, it follows that 



1 



dt. 



arctan(f/z) 



1 



dt - 



arctan(i/z') 



1 



dt 



< 



1 1 

z z' 



■dt 



Remarking that the integral on the right-hand side is convergent yields 



arctan(t/z) 



dt- 



arctan(t/z') 



dt 



= O 



1 1 



and the result follows. 



The next result of this section is a generalisation of Lemma 2 in Girard et al. (2012). It provides a 
uniform expansion of Mn{pn, x), see ([7]) in the proof of Proposition [21 which is the key to the proof 
of Proposition |31 

Lemma 5. Assume that (K) and {Ai — A2) hold. For all x u £ B and n G N \ {0}, let 

K{x. u) 



{fC){x - h„u)T{a{x - hnu) + 1) 

£„(p„, X, m) = , in exp 



A„(p„, x) 



{fC){x)V{a{x) + l) 

Mn{Pn, X) 



Pn- 



9{x) 



\0g{Pn)/K{x, u) 



If Pnh^n 0, then 



f{x)C{x)gP-ix)- 



sup 



A„(p„, x) 



- 1 



and 



sup 



^n{Pn, X) 



a{x)b{p„ + 1, a{x)) 

CniPn, X, u) K{u) du 







a{x)h{pn + I, a{x)) jb 
Proof of Lemma [5l Introducing 

{fC){x ~ hnu) T{a{x - hnu) + 1) 



= O ( /^II' V ^ 

Pn 



Qn{x, U) 



ifC)ix)T{a{x) + l) 



(16) 
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we have 



^n{Pn,x) ^ f O ^jPn + l + ajx)) ~ Ku) 

a{x)b{p^ + l,a{x)) 7s^"^ ' ^r(p„ + l + a(x-/i„zi)) gP-{x) > 
Since /, C and a are continuous on the compact set i7, they are uniformly continuous on VL. 
Furthermore, since a is bounded on f2 and T is continuous on (0, oo), the function x i— ?■ T{a{x) + 1) 
is uniformly continuous on fJ, so that 



sup sup \Qn(x, w) — 1| — ?> 



as n — ^ CXI. Moreover, since p„ hJit 0, we get 



sup sup I log(p„) A^(a;, u)\ = O {hl-\\ogPr^) = O 

xen ueB 



v^/v, |logp„| 



as — > oo and Lemma |4] yields 



sup sup 



exp(log(p„)A,^(x, u)) 



T{pn + l + a{x)) 
r(p,i + 1 + a{x - hnu)) 



Besides, 



where 



')P'^{x - hnu) 



exp 



Pn log 1 



gix) 



sup Suppn 

xen ueB 



AUx, u) 



gix) 







Pn 



o 



hi- 



as n — >■ oo, see ([3)). Replacing (fT8|) . (fTOjl and (|20| in (fTTl) gives both results. 



(18) 



(19) 



(20) 



The aim of Lemma [B] below is to linearise the random variable ^„ [x) appearing in the proof of 
Theorem [2] 

Lemma 6. The random variable S,nix) can be expanded as 

ux) = — k\x) - e\x) + ( - 1) cHx) - f^^^±i}-^ - 1) e\x) 

I VAi(a+i)p„+i(a;) / 



apn 



V-Pr. + l{x) 



where 



Ci'\x) = (p„ + l) 



Mp„ (x) 
Mp„+i(a;) 



P-P„+iix) fip,, [x) 



Mp„+i(a;) IJ-p^x) 



and C'i^x) = [(a + l)p„ + l] 



M(a+i)p„+i(a;) 



M(a+l)p„ + l(^) _ M(a+l)p„ (^) 
M(a+l)p„ + l(2;) M(a+l)p„(2:) 



Proof of Lemma [6j Straightforward computations yield 

apnUx)^D'i^\x)-D'^;^\x) 

with 



(21) 



iPn + 1) 



Mp„(a^) Mp„+i(a;) 



l^P,^+i{x) V-p^+i{x) 



lip^+iix) V'pAx) 



fJ-Pr,+iix) IJ'pAx) 



Dl?{x) := [(a + l)p„ + l] 



A*(a+i)p„(a;) ^(a+i)p„+i(a;) 



M(a+i)p„+i(a;) M(a+i)p„+i(a;) 



M(a+i)p,.+i(a;) M(a+i)p„(a;) 



M(a+i)p„+i(a;) /x(a+i)p„(a;) 
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This leads to 

Di!\x) = ^E^Ci'Hx) and i^i^)(x) = ^i^^±il^^e)(x); 
fJ-Pr^+i[x) M(a+i)p„+i(a;) 

replacing in (PT|) concludes the proof of Lemma [HI ■ 

We shall next take a closer look at the behavior of the functions e„(p„, x), see ([8)) in the proof of 
Proposition [2] We first introduce some tools necessary for this study. For an arbitrary set S, J-'iS) 
is the set of all sequences of functions u„ : N x 5 — > M, denoted by x). Let C{S) C J^{S) be 
the subset of all the elements u G J^{S) such that u meets the following requirements: 

(Qi) For all t e N, sup sup |u„(t, a;)| < oo. 

{Q2) For all t, t' G N, p„ sup sup |un(t', x) — Un(i, x)\ < 00. 

Finally, is a subset of C{S) whose elements are bounded from below: 

V(S) = {ue C(S)\yt e N, 3M{t) > 0, inf inf uJt, x) > M{t)}. 

neti xes 

Lemma [7] lists some properties of the sets C{S) and ^{S). 
Lemma 7. Let S be an arbitrary set. Then: 

(i) C{S) is a linear subspace of J-{S) which is stable under multiplication, 
(a) 'D(S) is closed under multiplication and division. 

(Hi) Let u e ^-{8) such that there exists a sequence of uniformly bounded real functions ((5„) on S 
with 

5.n{x) 



yt e N, sup 



1 



Pn + t 



= O 



Un{t, X) - 

xes 

Then u e V{S). 

(iv) If S' is a set endowed with a finite measure /i and if u G C{S x S") (resp. T>(S x S')), then 
{n, t,x)^ J Unit, (x, x')) ii{dx') e C{S) (resp. V[S)). 

Proof of Lemma [3 (i) Since it is straightforward that C{S) is a linear subspace of J-'iS), it 
is enough to prove that C{S) is closed under multiplication. Let u, v £ C{S) and let Wn{t, x) = 
Un{t, x) Vn{t, x). One has, for all x G S* and t, t' E N: 

Wn(t', x) - Wn{t, x) = U„(t', x)[Vn{t' , x) ~ Vn{t, x)] + Vn{t, x)[Un{t' , x) - U„(i, x)]. 

Since u and v satisfy requirements {Qi) and (Q2), this equality therefore shows that w satisfies 
(Q2), and (i) is proven. 



19 



(ii) Stability under multiplication is a direct consequence of (i). It is then enough to prove that if 
u e then 1/u e 'D{S). Let w — 1/u: w clearly satisfies (Qi) and for all t E N, the sequence 

inf w„{t, x) ) is bounded from below by a positive constant. Finally, for all t, t' e N, 



Pn sup sup 

neN x&S 



1 



- TTTtAtTTa ™P sup|M„(t', x) - u„(t, x)\ < oo. 



Un{t, x) Un{t', x) 

This is enough to conclude that w G C{S), and thus w G 'D{S), which concludes the proof of (ii). 

(iii) Just note that l/{pn + t) — l/pn + o{l/pn), from which (iii) readily follows. 

(iv) Let ueC{S X S') and 



V : (n, a;) H- / Un{t, {x, x')) ii{dx') G J^iS). 
Js' 

Then, for alH G N, since /i is a finite measure on S' , it follows that 

sup sup|t;„(t, x)\ < sup sup \un{t, {x, x'))\ / ii{dx') < oo. 

neN xeS neN {x,x')eSxS' J S' 

Besides, for all t' G N, 

PnSn-p S\Vp\Vn{t' , X) ~ Vn{t, x)\ < PnSWp SUp \Un{t' , [x, x')) - Un{t, {x, x'))\ j fl(dx' )< OO 

neN xGS nGN {x,x')eSxS' J S' 

SO that V G C{S). Letting u G I?(S' x S"), there exists M{t) > such that 



inf inf z;„(i, x) > M{t) / ^i[dx') > 

TiGN x£S J gi 

so that V G 'D{S), and (iv) is proven. ■ 

Lemma |8] below essentially gives the order of magnitude of Mn{pn + x) and the error term 
En{pn + t, x) in the expansion of fip^(x): 

Lemma 8. Assume that {Ai — A2) hold, and pn hn^ — >■ as n ^ 00. Then 

(^) {n, t, X) ^ ipr^+tri^) ^^""^HitA e m)- 

(11) [n, t, X) ^ (pn + i)["+^l(-) EniPn + t, x) € C (U) . 

Proof of Lemma [8j (i) Recalling the notations of Lemma [51 we have 

- f Q^ix, u) nPn + l + a{x)) g^-jx^ h u) ^^^^ 



a{x)h{pn + l,a{x)){fCgP^){x) Jb ' T{pn + I + a{x - hnu)) gP'^{x) 

Since 

(p„ + t)"(^) 6(p„ + i + 1, a{x)) = (P" + " ^ 5(p„ + a(a;) + 1), 

a(xj 

Lemma m and Lemma [71[ iii) yield 

(n, x) ^ (p„ + i)"^"^ KPn + i + 1, a(a;)) G V{n). (22) 
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Consequently, it is enough to show that 

{n,t,x)^ / g„ x, u — , r — „ +t( \ K{u)du<=,V{n). 

Jb r[pn + t + l + a[x-hnu)) 



From and in view of 

r{pn + 2 + a{x)) T{pn + l + a{x)) r(p„ + 1 + -A«(x, u) 



r(p„ + 2 + a{x — hnu)) T{pn + 1 + a{;x — hnu)) r(p„ + 1 + a{x — hnu)) p„ + 1 + a{x — /i„m) ' 
it follows by induction that 



(n, (x, u)) ^ — — — — ^ e V{n X B). 



Then, using the relation 



r(p,i + t + 1 + Q;(a; — /i„u)) 



{x-hnu) gP"{x-h„u) gP" {x - h„u) A^(x, u) 



(23) 



along with (I^D|) gives, by induction. 



gP^{x) 



gP^{x) g(x) 



(24) 



(n, (x, «)) ^ ^""^ ^ ^ 

As a consequence of Lemma Ov) , (i) is proven, 
(ii) First and foremost, recall that from 

En{Pn +t, x) ^ / {fgP"^*) {X - hnU) (p„ + t) Ia+ jS , D {Pn +t, X- hnU) K {u) du. 

Jb 

In view of Lemma El^iv) , it is then enough to show that 

[n, t, (x, u)) ^ [pn + t)["+^l(^)+i ^^^^y ~ T^+0,D{Pn + t, X - Ku) G C{n X B). 

gP^+*{x) 

Using (1231) J we shall only prove that 

{n, t, (x, u)) ^ (p„ + <)l"+^l(")+iX„+^,z5(p„ + i, a;-/i„u) eC(r! x B). 

Since 

and since (n, x) i— > (1 + t/p„)["+'^l(^^+^ G in view of Lemma [Tl^i) and (ii), it is sufficient to 

show the latter property for the function defined by 

Wn{t, {X, u))=p^^+^^^''^ + 'lo,+p^D{Pn+t,X-hnU). 

For aU i e N \ {0}, let Rt : [1, oo) [0, oo) be the function defined by 



(25) 





1' 


'1 


(- 


1 - - 






y. 





For alH e N \ {0}, Rt is a bounded Borel function on [1, oo), and one has, for all t < t' E N, 

Pn[Wn{t', {X, u))-Wn{t, {x, u))] Iq+^S + I, Di?^, _j (p„ + X - h^u) . (26) 
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Remark that for all j, tEN, {x,u)EilxB and every bounded Borel function H on ft x [1, oo), 



\Ia+f}+],H{Pn+t,X-hnU)\<b{pn+t,[a + P]{x-hnU)+j + l) SUp \H\. 

Qx [1, oo) 



Finally, Lemma [4] shows that 



sup 



b{pn + t, [a + I3]{x) + j + 1) 



r([a + /3](x)+j + l)p-["+''l(^)-^'-i 
The result follows from (El) and (1261. 



- 1 



The final result is particularly useful for providing a uniform asymptotic bound of the second-order 
moments that appear when computing the rate of convergence in the proof of Theorem [2] This 
result is an analogue of Lemma 4 in Girard et al. (2012). 

Lemma 9. Assume that {SP), (K), {Ai — A2) hold and pnh^i —>■ as n 00. Let (fe^.o) 
(bn^i) be sequences of Borel functions on 51 such that there exist sequences of Borel functions {Hn^o) 
and {Hn.i), uniformly bounded on [0, 1] with 

yy £ [0, 1], sup sup \bn,o{x) + bn^i(x)g(x - /i„w)?/| < Hn,o{y) {1 - y) + Elhl!i^_ 

xefl ueB Pn 

Then, the sequence of random variables 

Snix) = YP" [bn,o{x) + b„,i{x)Y]Kh„{x ~ X) 



is such that 



sup 

xGft 



g^^-{x)p-"^''^-^hn'' 
Proof of Lemma [9j Conditioning on X yields 

E|5„(a;)p = [ ^\y^p- K^^{x) + br,Ax)YY 



0(1) as n — > 00. 



X = v 



Kl{x-v)f(v)dv 



E 



Y^P- |6„,o(2:) + 5„,i(x)rr 



X = X — hr, 



K'^{u) f{x — hnu) du. 



Now, given X = x — hnU, we have Wn{x, u) :~ Y/g(x — hnu) < 1. Introducing the bounded 
sequence 



c„ := 2 sup {|i/„,oP, \Hn,i\^} sup sup 
[0, 1] xen ueB 



g^P" {x - hnu) 



Holder's inequality entails, given {X = x — hnu}, 

Y^P- \b„^o{x)+bn,i{x)Y\^ < c^g''P"{x)WlP-{x, u) 



g2p„(a;) 



(1- W„(x, u)f + ^ 

Pn 



It is therefore sufHcient to prove that, for all j e N: 

¥.{WlP^{x, u){l - Wn{x, u)y I X = a; - /i„u) 



sup sup 

x£Q ueB 



-a{x)-j 



= 0(1), 



(27) 
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Integrating by parts yields 

E(W"2P"(x, u){l-Wn{x, u)y I X = x-hnu) 



since, given {X — x ^ hnu}, Wn{x, u) has survival function J-{- \ x — hnu). To conclude, observe 
that if 7 is a positive Holder continuous function on W^, then 



/ ^ (1 _ T{y\x-h„u)dy 



< 2p„ y^P--^{l^yy F{y\x-Ku)dy 



y 



2p„-l 



Tyiylx - hnu) dy = 5(2p„, 7(x - hnu) + 1). 



From (fT9)) and Stirling's formula, it follows that 

sup sup pI^^^+^ f y^P--^y^{y\x-Ku)dy =0(1) 
kgo u£B Jo 

because p„ /iJl" -> as n — > oo. Finally, for all y e [0, 1], 

Tiy I v) = C{v)T^{y \v)+D («, (1 - y)-^) T^+piy \ v), 
and Lemma HJii) yields (|27p , which ends the proof of Lemma [^1 
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